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ABSTRACT 

The Electronic Homework assistant system is composed 
of two components: the Computer Tutor and the Homework Administrator. 
The Computer Tutor is an intelligent tutoring system that can provide 
personal assistance like supplying hints, checking errors, providing 
remediation and prioritizing problems. The Homework Administrator is 
a teacher's assistant in assigning and marking the homework, and 
summarizing errors for teachers' reference. Both components of 
Electronic Homework are composed of several modules. Different types 
of knowledge, mainly obtained from human experts, are incorporated 
into the Computer Tutor, and the pieces of knowledge, in the form of 
rules, are stored in the following separate modules: the expert 
module, which contains the knowledge that the system imparts to the 
student; the student module, which stores the knowledge of the 
students, both correct and incorrect, in the form of rules; the 
tutoring module, which contains the knowledge on how and when to help 
students correct their errors; and the communication module, which 
deals with the interaction between the user and the computer tutor. 
The Homework Administrator is responsible for handling routines 
normally done by teachers, which include ordering problems, 
collecting students' errors and marking students' work. The effect of 
using Electronic Homework was investigated among students of 
different academic abilities; in one school, students using the 
system performed better on less abstract problems,. A major 
shortcoming of Electronic Homework is that it reacts very slowly in 
some situations. (Contains 17 references.) (AEF) 
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Electronic Homework 

Fong-lok Lee & Rex M. Heyworth 
The Chinese University of Hong Kong 

•hey ™ "ha, 

have problems, some fortunate ones mav haL T papen When the students 
siblings or others who act as human fetors aSS ' Stance from lhe "' Parents, 

wan until the next day before they can ask fofZ Z , ^ W °“ ld have 'o 

doing their homework, they would have to resort to ofe^ P ' Bl “ While they are 
difficulties which, if unresolved mav her,, ber me ans of overcoming the 

It would be desirable if a (Va " Leta ' 

when he or she encounters homework problems. m3 C ^ ^ to hel P eac h student 

^-£££sonal Tu tor to Stndpn^ 

“ °fb Van b d aMife - better 
students of lower ability, misconceptions or emrs shTfd h" effec1 ' For 

before they become stable errors (VanLehn 19901 Ifth ! be corrected immediately 

continue, immediate help should be provided H ' If * ha studenls d ° not know how to 
reinforced and incorrect behavior avoided Meall T T' COrTeC ' behavior will be 
tutors. However, if human tutors are not availahl/’ h ' S Sh ° Uld be d ° ne by human 
human tutors may be an alternative solution. ’ C ° mpuler ,ulors ,hat can act like 

necessary condition isftTe^ch Itudem shotld S ha dent '* ^ ‘ ha " done ' The 

condition which is not fully met at the pre tj ZZ E™ 0 ™ 1 COmpu,er at b°“e, a 
prosperity of society and the lowering of the H °/ VeVer ' with the “creasing 
believed tha, the coming fewyears, this coSKSSS C ° mPU ' erS ' “ “ 

mathematics. Moa'^Sy^taMe 0 ^!^ softwa re, particularly in the area of 
mathematics focus on tutorial and drill a ^ PUter ' assis J ed instructional systems in 
1996) Students are glV en exeldses to **?*? ^ & 

form of multiple choice or short questions for which are either in the 

The purpose of such kind of software is to drftMh 1 7 * answers a re expected, 
certain degree of competence which is meae 1" studenls unt ‘l they can reach a 
Those who pass the test will be allowed to ^ ^ 3 t£St s ‘ mdar t0 the exercises 

Students who cannot pass the tes, wil7be Iskfd Z X, ^ ° f "* SyStam ' 

materials or be given additional materials to read mti rtT reV ' Se Certal " pa " S ° f the 

is no attempt to understand students' errors and all ?? maSler lhe sub j ec t. There 

errors and all remedial measures are prespecified. 

Shrvi.lrl n~ 

Recent computer systems have afiempted to understand students' errors then 



o 

ERIC 



3 



2 



provide assistance to h«i~ *u * . 

?9?8°L inear ^ 8ebraiC Jsi”' EXamPkS C “ be found i" the 

z “ ^*u^arr£ y F™n 8 Bo^ t£ss> 

8 7 - - “ - ■— =r.~ 

wouM^eThTvrafhTmfwo* h a 0 " d ° We t d ,0 “ ter Problems that they 
system has ,o be able ,o find om the ZZ: 7 '^ ^ * he 

2- Be^r hei'r 7“ ^ ***" ^ “ 

students. woTFule^^hThouW fete'f h h‘ P ***** in “ring 

E .«i7rrr;r y ~^’^ ro ^ 

of two components: the Computer wind SfT ' h '' S PUIp0se - 11 * oomposed 
omputer Tutor is an intelligent tutoring system Tt H ° mework Administrated The 
^e supplying hints, checking errors providdnld V™ Pr ° Vide personal assistance 
The Homework Administrator is a Prizing probl^ 

homework, and summarizing errors for the tearh V" ass, § nin 8 a ud marking the 

Homework, teachers would * r f rence - Wk en using El edfol 

containing the assignment for students to do at r* eWOrk b Y distributing floppy disks 
pace u n er he ance Qf ^ can work «2dr™ 

school, teachers do not have to mark or ™ * d y When the Y retu m the disks to 

been done by Electronic Homelol Bn, T h ° meWOrk because i, has a Ireadv 

work was done by coI,ec,m g ~ 0 pp v d LkT “a" J"? 3 C ' ear l**™ of how thl 
students progress and displaying it onlhe f d bav, "g lhe computer summarize 
focus attention on unprovtog the"? £££ SCr “"' Te -bers now have moreTm? te 

System Design 

components - the Co^^ 1 ^2tefto aChi i re ?“ ab ° Ve pu, P os es, both the 
composed of severs! modules. 

functions of these modules. S sectl0n s describe the contents and 

prescription of studenteW???";^" S ‘f ents ’ as well as give 
human experts, has to be incornorateri r^u of knowledge, mainly obtained from 
knowledge, in , he [ 0Tm of 1“ s ,„°r d f ° r **“ “ p “aion, the plcelof 
described more details in the foliowing p^pfc^ m ° dUleS ' Each “dole 

Morlnlp 



IS 



TWS m0d " COn ‘ a ' nS " k “ W,ed8a ' ba ' ' ba -tern imparts to the student, f, 
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called an expert module since it includes what 
concerned should know. As the present system T" in lbe Sub J ect area 

knowledge, it thus includes knowledge required 5 ti 1° ^ logarithmic 

However, solving logarithm problems may require nth 0ganthm Problems, 

solving algebraic equations, simplifying algebraic exnr F mathe ™ atlcs knowledge like 

the axiomatic rules, as suggested b^^^ the strategic and 

rules state what strategies would be used whT & Anderson 0987). Strategic 
while axiomatic rules correspond to heh • enever certain patterns are observed 
following examples found inThe Tea^A a ° COrdm8 ‘° T*™** axioms. The 
1 987) serve to illustrate this difference A PP rentI “ (Lewis. Milson, & Anderson, 



[Ri] 


IF 


^^“^ S ° ,VCd C ° ntainS 3 sube ^ession of 


[R2J 


THEN 


set as a subgoal to distribute num over terml and term2 


IF 


the goal is to distribute mim over terml and term2 




THEN 


set the subgoal to multiply num times terml 




AND 


set the subgoal to multiply num times term2 




AND 


set the subgoal to combine the previous results with + 


[R3J 


IF 


the goal is to multiply num times term 




THEN 


write the product of num and term 


[R4J 


IF 


the goal is to combine terml and term2 with a + 




THEN 


write terml 4- ter m2 



(Words in italics are variables.) 

In the above examples the rule n? n • . 

to the equation and sets the subgoal to^Lribut? 1112 ' 8 * distribution is applicable 
strategic rule. The other three te axiom t 7” ^ ^ and term2 ~ * is a 
according, „ distributive law, mu, ^ 

taowledgebaseofftesySm^owveracwXET'R h 08 "'’" form lhe doraain 

this domain knowledge base, there shouU be 2 605 ^ ° 991) ’ besides 

criterion-performance model. The domain k„„ TT “?*“ Which the y “H 'he 

^ow edge of the contents to be taught and the 2o 2 e f inC ' UdeS bo,h (he 

knowledge to solve related problems The criteri^ f ^ °" “ USe the content 

based expert that solves the same problem to'ml “h 7"“ ^ ' S 3 COm P uter ' 
evaluate the student’s performance sludem 50 that ,he system can 
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Model-tracing 

nxTZP 0 ” “~rr e^pT“ er ,he cr ‘ ter ' on -perfonnance mode, 
PIXIE (Sleeman, 1987; Moore & SeSTw? ft™ emp '° yin « "* ®o<W fa 

“r; t3'“~ : t«SJSgS2 *r— «-* M. ,. 

■netted of 

internal state by matching his output with th Pr °“ SS ’ the s^tem infers the learnefs 
and incorrect rules (referred to as buggies C”"' •«»« by ustogTdea 
Una inference. g8y m,esy '"Sections will be given according to 

advantages and disadvantages 8 The criterio ^non-performance model have their 
tutoring strategic. ” the Pr “ enl ** » 



J^-Stud entIVrnd.,1^ 



correct or incorrect, in^hVfom of mie^ TrVt^ kn ° wJed S e of *e students both 
broad categories: the quantitative method fP ^ d ] tl ° na,Iy » stud ent modeling is in two 
m conventional computer-based instruction (CBD ’ 1 Which is mos % used 
re and the qualitative method. Clancey (1988 n0t be elabora ted father 

ob?ects U ^d atlVe m ° dd " ^ ~ io ^ physTcata T says 

objects and processes in terms of snatial t* P , anaIo S ues - Rather, it describes 

been ma.niy two types of methods used to m JeT^Ms:^ rclati ° nS '” There ha «= 

computer expertf The expert’s comnet’ 5 Perfomlance is compared to that of th 

theTd ,ha t! ,hepupil eithert > aa iwXsnrrr d ‘° be br0ken iM0 a ^.ofskilis 
student has part of the expert's knowledge (E,Som - cook . 1988). In other words, 

“ 8 f? Id emo d rsl T C °"' ainS ^ d ° mai " 

student mode, with respect to the 



o 

ERiC 



BEST COPY AVAILABLE 



5 




Overlay Model 



Bug-identification Model 



and because the overlay modd dot^ot ^ 0 StU ? entS t0 COrrect their errors 
reasonable to say that the bu^Lt^on^T it would be 

present use. The student module in the present svlt n mOTe a PP r0 P riate for the 
addition to the correct rules The mal rules y ^ 1S !^ US formed by mal-rules, in 
from a se, of tests, called ntal-mfe ST d ^ Stl,deMS ’ ° b.ained 

(grade 9) students in Hong Kong. ’ 3 ministered to 125 secondary 4 

IhgJuto ring Module 

to correct their errors. TiTe fet^Wer^tos™ h ° W ™ d ^ ‘° hel P sluden « 
producing conceptual dissonance (by showL the Y Lee (1995) that 

contradictory to their previous knowledge) in the a ^ entS that their er rors are 
practising the correct rules can help them t c ^ ^ and havin § students 

methods hke reteaching and model baTed a ^ Cn0ra m0re effective ly than 
Ward & Moore, 1989). The prescriptive rul^ 1 ah tin (Sleeman, Kelly, Martinak, 
based on this principle. P USed ln Elect ronic Homework were 

^gument^o/ which oTthe^bove 0 nwdds^edf students’ errors relates to the 
model-tracing method, should be used The lten ° n ;P erformanc e model or the 

methods, however, are the amount of freedo mam dlfferences between the two 

interaction process, and the possibility f ° students to explore during the 

learning. In the ***** due t0 Complete 

thus allowing students to flomdTt eeW 1 tb ^ at * e end each problem, 
would make errors but it is J 6 Pr ° C ^ S ° f floundering, students 

recover them. Floundering may be good exnert ^ f W °u dlSC ° Ver their errors and 

recover errors since it helps the memorization nTth ^ Students who are able to 

who cannot discover their own errors found • ^ T' mle ‘ However > f °r those 
errors since the errors commixed Te n m W ° d beC ° me a source or future 

the other hand, the latter method keeps theTd^ “™ ediately f Va "Lehn, 1990). On 
the same, only forces them to memorize the comef T* ^ making errors - but at 
•hem. Hence both methods have their 

advantage that thereTsno nredmaore a f'"' 1 '’ model ‘ I,acln g m«hod has the 

to store a large number of problem solving models. 
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thus employed in the present'syTtem" SyS ‘ em ‘° ha " dle ' The mode l-tracing method is 



TheJ^mjTunjc ation Mnrt.,1. 



huraan and ,he cora p utw «■*»• 

and translating computer language into that " anguage into computer language 
they form the input and output component of £ JT™ “ nderstapd - Together 

of human language is not an easy task since hum! f res P ec, ‘«ly. The translating 
sometimes even illogical. To tackle this “ 8 “ age “ n0 > we " ^ned and is 

Meno Tutor (Woolf, 1987) use a kind of restricted la ' nte l,gent ^tenis such as 
on| y “ft a limited number of terms ^d toe ^ “ Whi ° h ,he ™cabula^ 
With this kind of language, the computeTcould the T'* i$ S,ric,l T defined, 
enters and react suitably. P d lhen tmderstand what the human user 

screen so that the'users i^^oosrdiei'rlc^^T by displa J' in 8 some icons on the 
icons with the mouse. An example is The TeTh • T P ' y Clicking ,he a PP™priate 
Anderson 1987). As only a limited numb' If ApPren,iCe (Lewis . Wilson, & 
the latter method is only capable of handling 1C °? S Can be dis P la yed on the screen 
former limited-language method cannot allow 'cZl'T ' H ° WeVer - even the ’ 

^ve **» « - , 0 

intended to be used by school students whn P 6 A [ S0, Electromc Homework is 

students, it would be easier for them to use mouTasT 8 °°/ * ^ For these 
reqmred m a logarithmic expression are tWore £ TV ^ A1) the ^bols 
tudents can simply use the mouse to click the ren • E ayed 0n the scree n so that 
expression the troublesome task of typing! foe exnre ^ t0 PUt * ^ their 0Wn 

mL S sin e g S, bmckeTs° Uld ^ ^ ChanCes of enors Tucks' 

other given the re ^ uired f onnula as well as 

divided into three parts: one for displaying rh a ^ aCCess ‘ Further > the screen is 
the other for displaying feedback to the student aX" 1?!,“ S °' Vin8 the problera . 
formula and constants. In this way the student * hlrd , one for displaying the 
concentrate during the problem solving process. lmn tcdiately know where to 



-^^-UsiPSWor!L Administr3t/-.e 



are normally donThf teathem "XVinclude"!^ f " ^ ha ? dli " 8 ° f routines 'hat 
“ ,he mark ‘ ng ° f 
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ProbJ^Ae^^ Their Bmm 

is'usu V tUdentS 0f h thdr dlfflCUlty 

this can only be determined after the item is ad nUmber ° f studen ts attempted. As 
present purpose. The present system uses a L d f' ed ’ Jt is im P0ssible for the 

(Lee, 1996) to arrange the problems The formula^ ^ ^ ProbIem Complexity 
is as follows: he t0rmula for calculating Problem Complexity 

Problem Complexity = 0. 1 1 x Machstep + 0. 1 9 x Notmfac + 

• Wx Familar +1.17 

problem^ Notmfhc t T?*' SyStera t0 s °‘™ the 

ssr invo,vin8 — s - sr- rtus as 

problems entered b^ teachers can te^rrtng^Lco ^ th ' S formula a nd 

have to take care of the ordering of problems. ° rdlngly - Teachers therefore do not 



is recorded whether the eraf i^fi^ com P uter , every error admitted 

on the floppy disk to be submitted. When all the disk ^ 1St n ° ferrors is then stored 
errors admitted by an individual student and a s, “! Collected > both the list of 

students can be seen on the computer monitor Th*? ° f , eiTOrs admitte d by all the 

know how well the students have learned " Can then ^mediately 

^tocStudents LWork js Scored 

by comparing the student’s answeTwith Ae V Mch' , ° bIem ° r n0t ^ ^ £asiIy checked 
score in doing an exercise can be obtained bvT^ generated ^ HenCe a stud ent’s 
or she correctly finished. This score is attaint C0Unbn S the number of problems he 
When this disk is collected the teacher can ' ° rG ,° n | be ^°PPy d isk to be submitted 
who.e class by having the computer display 'scZ^"" ° f ^ 

Effects of Using Electronic Homework 

results among students of diffe^TLadmk "l VeStlgated b >' contrasting the 

Electronic Homeworlt were found to h^ve plnTS 
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Effects Trrrr T EleCtr0niC H0meW0rk 15 not with visual and audio 

(i.e. the students are not reinforced with beautiful pictures or music after 

rrec y so ving a problem), and as it was observed that students in this particular 

schoo! were highly motivated toward using computer-assisted instructional system in 

heir learning, it is believed that motivation would be an important factor that affects 

the use of Electronic Homework. Although Electronic Homework is stm not y e S 

developed and was only evaluated in a short period of time, the fact tha t om posftive 

effects were observed shows that it is possible to help students with system" ike this 

„ , f A . m u aj °u Sh0rt ? 0ming 0f Electronic Homework revealed from a questionnaire 

Stte s^ 6 co nt$ H 1S ^ S1 ° W1 ^ ln SOme situations, Sty 

to the fact that theT? 0 ^ ma ^ aVailable in the system. This slowness is due 
_ faC ^ that ^ s y $tem has t0 scan over its stored rules before it can give out a 
gnosed error and that there is quite a large number of possible combinations of 

a'few yeTrs^Tfurth 15 * ^ machine ’ which ma y becom e possible within 

tew years. A further improvement may come from the fact that even though a 

srrrsr xv™ hnmm beings - yet in ^ 

m able to react quickly while the computer is still searching for possible solutions 
It is thus not the processing speed but the strategies used which determines how fast a 

h TT Stra,egieSCan be better understood can be incorporated tale 
system, a much faster system will be achieved. 

r Another posslble shortcoming of the system is the input method it allows 
Cumently students can use either the keyboard or the mouse pointer to in pu7 a 
mathematical expression. Yet the expression displayed can only be in the form of 1 
test expression. An example is that one half can only be displayed as 1/2 but not as the 
usual way of 1 over 2. Precisely how this would affect the'effect 
has to be investigated, but it seems that the system can be much improved if some 

system ^ ° f VVritin § pad or voice input can be incorporated into the 
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